Configure dbt Cloud Connection Details

dbt Cloud is a managed platform that provides a user-friendly, cloud-based interface for data teams to develop, test, and deploy data transformation SQL code. It offers features like a web-based IDE, built-in Git integration for version control, and job scheduling.

The Calibo Accelerate Platform supports dbt Cloud for custom transformation pipelines. You can import your existing projects into the platform and create and run a new job or run an existing job.

Configuring dbt Cloud connection details

1. Sign in to the Calibo Accelerate platform and click Configuration in the left navigation pane.
2. On the Platform Setup screen, on the Cloud Platform, Tools & Technologies tile, click Configure.
3. On the Cloud Platform, Tools & Technologies screen, in the Data Integration and Data Transformation section, click Configure.
(After you save your first connection details in this section, you see the Modify button here.)


4. On the dbt Cloud screen, do the following:

   1. In the Details section, provide the following details:

      Field	Description
      Name	Give a unique name to your dbt Cloud configuration. This name is used to save and identify your specific dbt Cloud connection details within the Calibo Accelerate platform.
      Description	Provide a brief description that helps you identify the purpose or context of this dbt Cloud configuration.

   2. In the configuration section provide the following details:

   Field	Description
   Account ID	Provide the account ID for dbt Cloud.
   Base URL	Provide the base URL for dbt Cloud.

   3. Depending on how you want to retrieve the credentials to connect to dbt Cloud, do one of the following:

      Field	Description
      Connect using Calibo Accelerate Orchestrator Agent	Enable this option to resolve your dbt credentials within your private network via Calibo Accelerate Orchestrator Agent without sharing them with the Calibo Accelerate platform. If the Cloud Service Provider is AWS, then provide the following details: Select the Calibo Accelerate Orchestrator Agent for AWS. Secret Name - provide the name with which the secret is stored in AWS Secrets Manager. dbt API Token Secret If the Cloud Service Provider is Azure, then provide the following details: Select the Calibo Accelerate Orchestrator Agent for Azure Vault Name - provide the name of the vault where the secret is stored in Azure Key Vault. dbt API Token Secret - provide the dbt API key secret.
      Test Connection	Click Test Connection to verify the provided details and ensure that the Calibo Accelerate platform is able to successfully connect to the configured dbt Cloud instance.

   4. In the Configuration section, do the following:
      • Existing DBT Projects - select the existing dbt projects that you want to import.
      • Click Add. The selected projects are listed under Imported Projects.
5. Secure configuration details with a password
   To password-protect your Snowpark connection details, turn on this toggle, enter a password, and then retype it to confirm. This is optional but recommended. When you share the connection details with multiple users, password protection helps you ensure authorized access to the connection details.

6. Click Save Configuration. You can see the configuration listed on the Data Integration and Data Transformation screen.

Recommended Topics

What's next? Data Transformation using dbt Cloud